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1  Introduction 


In  [HM84j,~lIalpern  and  Moses  present  an  interesting  discusssion  of  knowledge 
and  common  knowledge  for  distributed  systems.  They  argue  that  while  common 
knowledge  is  desirable,  it  is  unattainable  in  certain  settings.  They  suggest  a 
hierarchy  of  weakened  versions  of  common  knowledge  and  discuss  when  these 
can  be  achieved. 

One  difficulty  with  the  Halpera  and  Moses  paper  is  that  it  is  informal  and 
the  concepts  dealt  with  are  not  rigorously  defined.  Given  one  interpretation, 
their  theorems  are  true  as  claimed,  but  given  another,  the  opposite  occurs,  as  we 
show  with  appropriate  counterexamples.  Thus,  their  theorems  are  not  wrong  in 
spirit,  but  the  concepts  are  subtle  and  the  tc""»  be  more  carefully  defined. 

'•  In  the  main  body-ofHhis  papery**'  give^uite  general  and  precisedefizuiions 
of  distributed  protocol,  knowledge  and  common  knowledge.  Jdhfe  also  provide* 
precise  settings  and  rigorous  proofs  for  many  of  the  results  in-f 
propose^ me  alternate  definitions  in  which  the  same  results  become  false. 

O' fit Qnn  derire'lf' to  develop  a  way  to  design  clear  distributed  algorithms  and 
write  clear  proofs  about  them.  v.  We  believe  we  have  provided  a  solid  base  for 
future  work  in  this  area. 
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2  Definitions 

Definition  2.1  A  distributed  protocol, 

P  =  (n,Q,l,r), 

contidt  of  s  number  n  of  participant*,  a  act  Q  of  local  itate*,  a  cct  I  £  Q*  of 
initial  global  date*,  and  a  neat  move  relation  r  C  Qn  x  QH  on  global  date*. 

Our  definition  of  protocol  is  certainly  simple  and  precise.  Let  us  first  argue 
that  it  is  sufficiently  general.  Anything  we  would  be  willing  to  call  a  distributed 
system  can  be  broken  up  into  a  finite  number  of  logical  entities.  Each  such  entity 
must  be  in  some  total  configuration  that  we  are  calling  its  state.  Ftothermore 
the  states  of  all  the  components  combined  should  determine  the  entire  state  of 
the  system  and  thus  which  global  states  can  be  next  entered. 

It  is  easy  to  see  for  example  that  our  model  of  distributed  system  is  a  gen¬ 
eralization  of  the  shared  variable  model  of  Lynch  and  Fischer  [LF8lj.  In  that 
model  the  components  consist  of  shared  variables  and  processors.  Each  action 
involves  exactly  one  processor  and  one  shared  variable. 

Similarly  our  model  includes  synchronous  protocols  in  which  every  processor 
sends  a  message  to  every  other  during  each  round.  One  way  to  model  this  is  to 
specify  that  the  set  of  possible  states  is  of  the  form  Q  =  Mn,  i.e.  each  processor’s 
total  configuration  consists  of  an  n-tuple.  We  can  specify  that  the  t,h  entry  of 
fa  state  is  the  value  of  the  message  sent  from  i  to  j  during  the  previous  round. 
This  can  be  done  as  follows:  for  all  processors  i,  j,  and  for  all  global  states  p, 
q,  r,  a,  if  (p,  q)  and  (r,  a)  are  in  r  and  if  processor  *  has  the  same  state  in  p  as 
in  r,  then  the  «‘h  component  of  processor  fa  state  is  the  same  in  q  as  in  s. 

The  sense  in  which  our  model  could  be  too  general  is  that  we  allow  any 
transition  relation  r.  Of  course  for  certain  applications  we  can  make  appro¬ 
priate  restrictions.  We  have  already  seen  that  we  can  restrict  our  attention  to 
processors  which  communicate  with  shared  variables,  or  to  synchronous  mes¬ 
sage  passing  protocols.  Similarly,  instead  of  letting  each  processor’s  transitions 
be  perfectly  general,  we  can  restrict  our  attention  to  processors  with  specified 
computing  power,  e.g.  finite  automaton,  polynomial  time  Turing  machine,  etc. 

For  any  protocol  P,  let  R*  be  the  r-reachable  global  states  of  P,  that  is,  the 
set  of  all  global  states  we  can  reach  by  starting  in  I  and  taking  any  number  of 
r  steps.  For  p  €  Qn  a  global  state  and  1  <  t  <  n,  we  write  (p),  to  denote  the 
t*h  component  of  p. 

For  any  two  states  p,q  €  Rp  and  any  participant  i,  we  will  use  the  notation 
p  ~  q  to  mean  that  ( p)<  =  (</),,  i.e.  they  are  indistinguishable  from  i’s  point 
of  view.  Obviously  each  ~  is  an  equivalence  relation.  For  any  reachable  global 
state  p,  define  the  i -neighborhood  of  p  as  follows: 

Ni(p)  -  {?  |  ?  ~  p) 
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If  we  are  in  state  p,  then  all  t  “knows*  is  that  we  are  in  Ni  ( p ).  Therefore, 
for  any  sentence  a,1  it  is  natural  to  make  the  following  definition  of  K,a,  which 
we  read  as  “t  knows  a*: 

< P,P )  NM  *  €  Ni{p)((P,q)  (=  or) 

Intuitively  t  knows  a  just  if  a  is  true  in  all  the  worlds  which  are  indistinguishable 
by  i  from  the  current  world. 

It  is  convenient  to  picture  a  protocol  P  as  a  graph  with  nodes  consisting  of 
all  the  elements  of  Rp .  There  is  a  directed  edge  labelled  r  from  p  to  q  just  if 
(p,  q)  €  r.  Furthermore  there  is  an  undirected  edge  labelled  ‘t  ’  between  p  and  q 
just  if  p  ~  q. 

Let  G  S  {I,  .  ..,n}  be  a  group  of  participants  in  a  protocol.  For  any  p  €  Rp, 
define  the  G ‘neighborhood  of  p  as  follows: 

JVc(p)  =  {7  |  (Hr  >  0)(3t i, . . . , ir  €  G)(3pi,...,pr-i)Ip  ~  pi  ~  pa-.-Pr-i  ~  7]} 

This  generalizes  our  previous  definition  since  Ni(p)  =  iV{,j(p). 

Analogously  to  our  definition  of  K,ar,  we  define  CGcr,  which  we  read,  “it  is 
common  knowledge  among  the  members  of  G  that  a”: 

{P,P)\=Cao  s  Vq<=Na(p)((P,q)  h«) 

We  write  C  for  CG  and  N  for  iVG  in  the  special  case  that  G  includes  all  partic¬ 
ipants. 

The  next  result  shows  that  Co  coincides  with  the  intuitive  definition  current 
in  the  literature.  (See  for  example  [HM84].) 

Theorem  2.2  The  following  two  etmtemente  are  equivalent: 

(*\p>  h  Cc«- 

e.  (Vr  >  0)(Vn . »v  €  G)({P,p)  |-  Kit  K„  . . .  K,,o). 

Proof 

(1  =>  2):  For  any  0,  we  have  Cg0  —  0  since  p  €  iVG(p).  Thus,  it  suffices  to 
show  that  for  any  0 ,  if  {P,p)  (=  CG£,  then  for  all  i  6  G,  {P,  p)  (=  CGK,$.  This  is 
clear  because  if  q  €  Na{p)  and  <f  €  N%{q)  then  q'  €  Ng(p);  hence  {P,q)  K.-/J. 

Since  K,0  holds  for  all  9  €  iVG(p),  it  is  common  knowledge  in  G  at  p,  as  desired. 

(2  =*  1):  Suppose  that  (P,p)  CGo.  It  follows  that  there  is  a  q  €  iVG(p) 
such  that  (P, 7)  (=  ->o.  Let  t'i,...,tr  €  G  be  such  that  there  exists  pi,...,pr.| 

with  p  ~  Pi  ~  pa...pr- 1  ~  7.  It  follows  that  (P,p)  -,K,1 K„  ...K,,o.  I 

'We  have  intentionally  left  the  lofieai  language  unspecified  from  which  the  sentence  a  is 
drawn,  for  all  that  we  require  is  that  it  he  possible  to  interpret  a  at  the  pair  (P,p). 


We  conclude  this  section  with  two  nontrivial  examples  of  protocols,  one 
asynchronous  and  the  other  synchronous.  These  protocols  will  be  frequently 
referred  to  in  the  remainder  of  the  paper. 

Let  X  *  (n2,Qt,It,Ti)  be  an  asynchronous  message  passing  protocol  de¬ 
fined  as  follows:  The  tot  n  participants  of  X  are  the  processors  at, ...,a»;  the 
remaining  (n  —  l)n  participants  are  buffers.  For  a  global  state  p,  we  abuse  our 
previous  notation  slightly  and  write  (p)*,  to  denote  the  component  correspond¬ 
ing  to  di  and  (p)»4,y  to  denote  the  component  corresponding  to  buffer  Ki- 

The  set  of  possible  local  states  of  a  buffer  6,,y,  s'  ft  /,  is  MU  {A},  where  M  is 
a  set  of  possible  messages  and  A  is  a  special  symbol  denoting  the  null  message. 
Ki  =  m  €  M  indicates  that  the  single  message  m  was  sent  by  i  but  not  yet 
delivered  to  j.  Kj  *  A  indicates  that  no  message  is  waiting. 

The  set  of  possible  local  states  of  a  processor  a,  is  (D  x  Mn~l  x  N).  State 

indicates  that  the  processor  is  in  internal 
state  d  at  round  r  with  pending  messages  mt,...,m<-i,mt'.ti,...,mn.  If  r 
is  even,  then  the  processor  is  in  a  ‘send’  state,  waiting  to  place  each  my  ft  A 
into  buffer  6,  j.  If  r  is  odd,  then  the  processor  is  in  a  ‘receive’  state  waiting  to 
fetch  a  message  from  6y,,  for  each  j  such  that  my  =  A. 

Thus,  the  complete  set  of  local  states  is  (M  U  {A})  u  (D  x  M*~l  x  N). 

The  transitions  making  up  r>  are  of  four  kinds: 

1.  (p,  q)  €  Sendij  if 

•  p~q  for  all  e {<n, bitj }; 

•  (?)»..>  * 

•  («)»,.,  *  "v  *  A? 

•  (p)«<  ®  (d, . . ., my— j, my, . .. ,2fc); 

•  (q)<n  ~  (d, •  > • , my—  i, A,..., 2k). 

2.  (p,  q)  €  Receive,,)  if 

•  p  ~  q  for  all  c  £  {a,  ,6ylt }; 

•  (pW<  ~  mi  *  X' 

• 

•  (p)«<  =  (d,  •  ■  • ,  my-!,  A,...,  2k  +  1); 

•  (q)**  *  (d, •  •  • , my— x,  my, • . ., 2k  +  1). 

3.  (p,q)  €  Stopi  if 

•  p  ~  q  for  all  c  ft  a<; 

•  (p)a,  =  (d,  A,  •  •  • ,  A,  2k); 

•  (q)e,  s  {d, A, . . ., A, 2k  +  l). 
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4.  {p,  q)  €  Starti  if 

•  p  ~  9  for  all  c  a,; 

•  (p)„  =  (d,  mx, . . . ,  m,,  2k  +  1),  where  my  A  for  all  j  ft  i; 

•  (q)^  =  (<7, mj,... , mj,,2fc  +  2),  where  m'  ^  A  for  all  j  #  i,  and  <f 
and  my  are  functions  of  2fc  +  I). 

Now  we  let  rg  consist  of  all  the  above  transitions: 

rg  ss  Sendi,;  U  Receive j  U  Stopi  U  Starti 
ij 

Finally  let  7/  be  some  nonempty  set  of  global  states  in  which  the  state  of 
every  processor  a,  has  the  form  (d,m with  my  ^  A  for  all  /  /  t, 
and  all  the  buffers  are  empty. 

Our  second  example  of  a  protocol  is  a  synchronous  version  of  A.  Let  B  = 
(n3,Q»,rt,It),  where 

Q,  a{A}u(Dx  AT- 1  x  {2r|rgN}) 

Thus  in  B  all  buffers  are  empty  and  the  local  states  of  the  a,’s  are  the  corre¬ 
sponding  states  from  A  at  the  beginning  of  a  send  phase.  Let  the  transitions  Tg 
consist  of  all  pairs  (p,  9)  such  that  there  exists  a  r/  path  in  A  from  p  to  9  such 
that  none  of  the  intermediate  steps  go  through  global  states  of  B.  Finally  let 

fa  *  fa¬ 
it  is  not  hard  to  see  that  B  is  a  synchronous  version  of  A  such  that  in  each 
round  all  processes  send  n  —  1  messages  and  then  receive  n  —  1  messages. 

3  Common  Knowledge  in  Asynchronous  Sys¬ 
tems 

Definition  3.1  We  will  call  a  protocol,  P  =  ( n,Q,I,r ),  totally  asynchronous 
if  for  all  (p,  9)  €  r,  p  sod  9  differ  on  at  moot  two  components. 

The  following  theorem  shows  that  in  a  totally  asynchronous  protocol,  no 
new  common  knowledge  can  be  acheived. 

Theorem  3.2  Let  P  be  0  totally  asynchronous  protocol  ond  G  a  set  of  at  least 
three  participants.  Let  p  he  any  global  state  of  P  and  let  po  be  an  intial  state 
from  which  p  is  reachable  by  a  sequence  of  r  steps.  Let  a  be  any  sentence  in  a 
logic  for  P.  If  { P,p )  Coo  then  (P,Po)  h  C 00  . 

Proof  We  first  show  that  if  p  is  reachable  from  po  by  a  sequence  of  r  steps 
then  Ng{p)  —  Ng(po)-  It  suffices  to  consider  the  case  where  (po, p)  €  r.  By 
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the  definition  of  a  totally  asynchronous  protocol,  p  and  po  must  agree  on  all 
but  at  most  two  components.  Thus,  there  exists  a  participant  j  €  G  with  the 

same  local  state  in  pp  as  in  p,  i.e.  po  ~  p.  It  follows  that  p  €  Wg(po)  and 
thus  Na(p)  *  iVc(Po)-  The  theorem  now  follows  from  the  definition  of  common 
knowledge  in  G.  I 

As  an  example,  consider  the  protocol  A  discussed  at  the  end  of  the  last 
section.  It  is  easy  to  check  that  A  satisfies  the  definition  of  totally  asynchronous 
and  thus  no  new  common  knowledge  can  arise  in  A.  By  way  of  contrast,  if  we 
look  at  A's  cousin  8,  then  one  observes  that  all  reachable  global  states  in  8 
have  all  processors  in  the  same  round.  Thus,  if  two  reachable  global  states  are 
~  equivalent  for  some  t,  1  <  i  <  n,  then  they  are  both  in  the  same  round.  It 
follows  that  if  we  let  G  —  {ai,...,an}  be  the  set  of  processors — i.e.  we  don’t 
care  what  the  buffers  know — then  at  any  round  r,  ‘Cc(we’re  at  round  r)’  holds, 
i.e.  it  is  common  knowledge  in  G  that  all  processors  are  at  round  r.3 

It  would  seem  at  first  glance  that  the  difficulty  in  achieving  common  knowl¬ 
edge  has  to  do  with  the  problem  of  reaching  an  arbitrary  depth  of  K’s  with  only 
finitely  many  messages.  We  conclude  this  section  with  a  look  at  finite  state 
protocols  where  common  knowledge  is  equivalent  to  a  finite  stack  of  K’s. 

Theorem  3.3  Let  P  =  (n,Q,I,r)  be  a  finite  state  protocol,  i.e.  |Q|  <  oo.  For 
each  i,  let 

Qi  ~  {(?)•  I  9  €  Rp  } 

Thus  each  processor  is  a  |Q,|  state  automaton.  Let  r  =  min{|Q,|  |  1  <  t  <  n}. 
Let  p  be  any  global  state  and  let  a  be  any  formula.  Then  the  following  are 
equivalent: 

1.  (P,p)^Ca. 

2.  For  all  <1,13,..., i3r-ii  (( P , p)  N  Ku  •  •  •  *•»,-,«) • 

Proof 

(1  2):  By  definition  of  C. 

(2  =»  1):  Suppose  that  {P,p)  Car.  Then  there  must  exist  q  €  N(p)  such 
that  (P,  q)  ->a.  Consider  a  minimum  length  ~  chain  from  p  to  q: 

P  =  Po  ~  Pi  ~  Pa  •  •  •  Pi- 1  ~  P.  =  <7 

Note  that  no  nonconsecutive  pair  p},Pk  can  agree  on  some  component  be* 
cause  if  they  did  the  chain  could  be  shortened.  It  follows  that  in  any  given 
component  each  state  appears  at  most  twice.  Therefore  s  <  2r  —  1.  It  follows 
that 

_ {?,P)  h  “,K„  K„  •  •  •  a 

3This  iMuma  of  course  that  our  logical  language  ia  powerful  enough  to  express  the  property 
‘we’re  at  round  r‘. 
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Example  3.4  Consider  the  protocol  P,  =  (2,  {1, . . . , r  +  1},  {(1, 1)},  rT)  where, 

*  *  { ((»', «),  (i  +  1, «'»  I  1  <  *  <  r}  U  { «t  +  1, *),  (t  + 1, *  +  1))  I  1  <  *  <  r }. 

This  protocol  hoe  the  unique  computation  chain: 

(1,1),  (2,1),  (2,2),  (3,2),...,(r,r  —  1),  (r,r),  (r  +  l,r). 

Furthermore,  for  alt  global  etatee  p  and  q  we  have  N(p)  =  N(q).  Thus,  for  any 
a, 

( Pr ,  p)  1=  Co  o  for  allqe  R?r ,  ( Pr ,  q)  h  <*• 

Let  a  tap  that  processor  1  is  not  in  state  1.  Then  (Pr,  (1, 1))  a,  so 
(Pr,  (r  +  1,**))  ^  Ca.  On  the  other  hand,  it  a  easily  seen  that 

(Pr,  (r  +  1,  r))  (=  K2K, K2Kx . . .  K2Kt  a 

*1““ ^ 

2r- 2 

It  follows  that  for  all  ii,  «2, . . . ,  ijr-i  €  {1, 2}, 

(^r»  (*"  "l"  lf^))  Is  ^»i  •••  Kilr_2Or, 
showing  that  the  bound  in  Theorem  8.3  cannot  be  improved. 

4  Alternate  Definitions  of  Knowledge 

According  to  Halpern  and  Moms,  “If  Cp  is  to  be  attained,  ail  processors  raus> 
start  supporting  it  simultaneously.”3  Unfortunately  the  notion  of  two  distant 
events  occuring  simultaneously  has  no  meaning  in  modern  physics.  Do  Halpern 
and  Moses  plus  Einstein  imply  that  no  real  distributed  system  ever  achieves  new 
common  knowledge?  A  corollary  would  be  that  no  real,  synchronous  distributed 
system  can  exist. 

A  look  at  our  example  protocols  A  and  8  reveals  that  they  are  realistic. 
Recall  that  new  common  knowledge  among  the  n  processors  is  attainable  in  B 
but  not  in  A.  This  is  all  the  more  confusing  becauM  in  a  very  strong  sense  A 
and  B  are  isomorphic  protocols  (cf.  [CM85]).4 

The  difference  between  protocols  A  and  8  concerns  the  granularity  at  which 
processors  in  the  two  protocols  may  introspect.  In  8 ,  processors  are  only  allowed 

*[HM84),  Lemma  2. 

4 We  will  call  a  pair  of  protocols  such  as  A  and  B ,  all  of  whose  interactions  are  accomplished 
by  a  series  of  messages,  itomorphie  if  the  set  of  messages  sequences  they  generate  is  identical 
up  to  permutations  which  de  not  switch  the  order  of  a  send  and  a  receive  by  the  tame 
participant,  nor  the  order  of  a  send  and  its  corresponding  receive. 
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to  think  about  what  they  know  at  the  start  of  each  write  phase.  When  two 
isomorphic  structures  differ  on  some  property,  we  become  very  suspicious  about 
whether  or  not  that  property  is  well  defined.  In  the  present  case  we  must 
reexamine  our  definitions  of  knowledge  and  common  knowledge. 

Let  P  be  any  protocol  and  let  5  C  Rp  be  any  subset  of  reachable  global 
states.  For  each  i,  let  ~s  be  the  restriction  of  ~  to  5x5.  We  can  now  generalize 
our  previous  definition  of  neighborhood.  Let  G  C  {1, . . . ,  n}  be  a  group  of  the 
participants  in  a  protocol.  For  any  p  €  5,  define  the  G -neighborhood  of  p  with 
respect  to  S  as  follows: 

&S(p)  =  {«  |  (3r>0)(3i|,...,«V€C7)(3p1,...,pr.l6  5) 

(p  ~S  Pi  ~S  P2  •  *  •  Pr—  1  ~S  <?1} 

Intuitively,  «  knows  only  about  the  global  states  in  5.  We  thus  define  Kf  or 
as  follows:  for  p  €  5, 

<P,p)|=K?a  =  V?6iVf(p)((P,,)|=a). 

Similarly,  we  can  define  common  knowledge  in  G  with  respect  to  5: 

<P,p)hC|a  3  ^€N$(P)({P,q)^a). 

It  is  easy  to  see  that  the  following  generalization  of  Theorem  2.2  holds: 

Theorem  4.1  Let  S  C  Rp  and  let  G  C  (1, ...,n}.  For  p  6  5  the  following 
two  statements  are  equivalent: 

I-  (P,P)  f=CG«- 

8.  (Vr  >  0)(Vn, .  ..,»r  €  G)({P,p)  Kf,  Kfa . . .  Kf  a). 

The  following  theorem  shows  that  for  any  protocol  P  and  any  nonempty 
5  C  Rp,  the  operators  K5  and  C5  satisfy  the  standard  S5  axioms  for  knowledge 
operators.  It  follows  that  if  we  consider  the  protocol  A  with  5  =  Rg,  then 
we  get  a  quite  reasonable  definition  of  knowledge  and  common  knowledge  for 
which  the  asynchronous  protocol  A  does  attain  new  common  knowledge.  This 
contradicts  Theorem  3  of  [HM84].  More  importantly,  these  observations  show 
the  definitions  of  knowledge  and  common  knowledge  needed  to  make  useful 
progress  in  the  understanding  of  distributed  protocols  are  much  more  subtle 
than  one  might  have  at  first  thought. 

Theorem  4.2  For  any  protocol  P,  any  nonempty  5  C  Rp ,  and  G  C  {1, . . .,  n}, 
the  operators  Kf  and  Cf  satisfy  the  standard  S5  axioms  for  modal  operators. 

Proof  This  is  immediate  from  the  fact  that  each  ~s  is  an  equivalence  relation. 
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5  Conclusions 


We  have  given  precise  formulations  of  distributed  protocols.  For  any  subset 
5  of  the  reachable  states,  we  have  given  a  precise  definition  of  knowledge  and 
common  knowledge  with  respect  to  5.  We  have  presented  theorems  outlining 
some  cases  where  new  common  knowledge  can  be  attained  and  some  cases  where 
it  cannot.  Most  strikingly,  we  have  shown  that  in  some  situations  two  plausible 
choices  for  5  can  give  completely  different  results. 

One  can  now  ask  the  question,  “For  which  sets  of  protocols  is  there  a  ‘best’ 
choice  for  S?”  and  thus  a  ‘best’  definition  for  knowledge  and  common  knowl¬ 
edge.  We  suspect  that  in  at  least  certain  situations  there  may  be  such  a  best 
5,  and  that  in  this  case  knowledge  and  common  knowledge  with  respect  to  5 
may  be  valuable  tools. 

Many  arguments  in  distributed  systems  are  first  formulated  at  the  intuitive 
level  of  what  certain  processors  ‘know’  at  certain  points  in  the  computation. 
With  precise  definitions  for  these  concepts,  it  may  be  easier  to  formulate  clear 
and  correct  proofs.  We  believe  that  considerable  work  is  needed  in  order  to 
develop  logical  tools  and  demonstrate  their  usefulness  on  problems  of  interest 
in  distributed  systems. 
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